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ABSTRACT 


This  paper  first  considers  a  general  mapping  v  of  points  z  in  RN  into  points 
v(z)  in  the  same  space.  It  is  shown  that  classical  mathematical  programming 
problems  can  all  be  restated  as  finding  among  those  vectors  z  ;>  0  which  map 
into  w  ^  0  ,  one  which  minimizes  z  w  .  For  a  differentiable  mapping  w  with 
a  positive  semi-definite  Jacobian  matrix  the  obviously  sufficient  ("complementary 
slackness")  condition  z  w  =  0  for  a  minimum  is  shown  to  be  necessary. 

Next  considered  is  the  case  which  includes  quadratic  and  linear  programming: 
w  -  Mz  +  q  where  q  is  a  fixed  vector  and  M  is  positive  (semi-)  definite 
with  constant  coefficients.  It  is  noted  that  the  definiteness  property  is  pre¬ 
served  for  any  equivalent  system  generated  by  an  interchange  of  a  subset  of 
corresponding  complements  of  z  and  w  or  what  is  the  same  thing  by  a  "block " 
Pivot  on  a  principal  minor  of  M  .  Since  this  result  is  related  to  recent  ones 

obtained  by  A.  Tucker  and  F.  Wolfe,  it  is  planned  to  incorporate  its  proof  in 
a  separate  joint  paper. 

Finally,  a  simple  constructive  solution  of  quadratic  and  linear  programs  is 
presented.  In  a  sense  the  simplex  method  for  linear  programs  and  the  results 
of  Barankin,  Dorftnan,  Wolfe,  Beale,  and  Markowitz  on  quadratic  programs  re¬ 
appear  here  but  toe  curiously  free  of  primal-dual  structure.  Complementary  pairs 
of  variables  play  a  key  role. 


POSITIVE  (SEMI-)  DEFINITE  MATRICES  AND  MATHEMATICAL  PROGRAMMING 

i — The  Optimality  Criterion  and  Its  Application 

LSt  “  (wi(z)"“'>wn(z))T  be  an  arbitrary  vector  function  mapping 

R  into  itself.  Given  the  mathematical  program 


Minimize 


T  ,  x 
z  w(z) 


^  subject  to  w(z)  ^  0 

z  0 

an  obviously  sufficient  condition  for  the  optimality  of  a  feasible  vector  zc 


'2'  z°  w(z°)  «  0 

which  implies  that  for  each  j  =  1,...,N  ,  at  most  one  of  z°  and  Vj(z°)  may 
be  positive.  Under  certain  circumstances,  (2)  is  also  a  necessary  condition  of 
the  optimality  of  z°  in  (l).  For  instance,  assume  that  w(z)  is  a  differen¬ 
tiable  mapping.  Denote  by  [dw/dz]  the  transposed  Jacobian  matrix, 

[dwJ/3z±]  .  (For  this  notation  and  terminology,  see  [1].)  It  will  furthermore 

be  assumed  that  the  Kuhn-Tucker  constraint  qualification  [8]  is  satisfied  by 
the  set 


{z  |  w(z)  ^  0  ,  z  0) 

Let  [5w/3z]  denote  [dv/dz]  with  each  of  its  entries  evaluated  at  z°  . 

— -0REM  1 :  ^  Gv/dz]°  is  positive  semi -definite,  and  if  z°  is  optimal 

for  (l),  then  z°Tw(z°)  a  0  . 


PROOF :  The  hypothesis  that 


is  optimal  for  (l)  implies  [8,  Theorem  1] 


that  there  exists  an  N-vector  ?\ 


such  that 


w(z  )  +  [dw/dz]°(z°  -  A)  ^0 
z°T{w(z°)  +  [dw/dz]°(z°  -  *)}  0  o 

?yTw(z0)  .  o 


Utilize  these  facts,  the  feasibility  of  z°  ,  and  the  positive  semi 
definiteness  of  [dw/dz]°  ,  we  obtain 


z°T[^/SzJ°(> 


z  )  (z  "  ^)  [dw/Qz]°(^  -  z°)  ^  o 


Thus,  equality  holds  throughout  and  the  proof  is  complete. 

We  make  no  claim  that  these  are  the  weakest  conditions"  under  which  the 
theorem  is  true;  nevertheless,  they  are  easily  stated.  Under  the  hypotheses 

set  forth  above,  Equation  (2)  becomes  an  optimality  criterion  for  a  feasible 
vector  z°  in  the  program  (l). 

Some  of  the  familiar  statements  of  duality  in  linear  and  nonlinear 
programming,  see  [3]  and  [6J  ,  can  be  derived  from  twice  continuously  dif¬ 


ferentiable  functions  K(x,y)  which  are  strictly  convex  in  x^O  and 
strictly  concave  in  y  ^  0  .  (The  strictness  can  be  dropped  when  the  function 
K(x,y)  is  of  the  quadratic  type  (5)  shown  below.)  Indeed,  associated  with 
K(x>y)  is  a  pair  of  dual  programs,  see  [5]. 


obtained^rapplyi^  Frft fiohn'fSeo^em^S] ?n  matrlX’  the  reSUlt  Can  be 
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PRIMAL 

DUAL 

Minimize  K  -  yT[dK:/dy] 

subject  to  [dK/fcy]  £  0 

x  ^  0 

y  0 

Maximize  K  -  x'r[dK/dx] 

subject  to  BK/£x]  ^  0 

x  0 

y  k.  0 

Let 


(  J  a  tdK/dx]  ^0  ,  v(x,y)  =  -[dK/By]  ^0 

z  -  (x,y)  ,  w(z)  =  (u(x,y)  ,  v(x,y)) 

We  seek  a  z°  0  such  that  w(z°)  ^  0  and  z°Tw(z°)  =  0  ,  for  such  a  z° 
is  feasible  in  both  the  primal  and  the  dual  and  makes  their  objective  functions 
equal.  This  condition  is  also  necessary  as  may  be  derived  from  the  duality 
theorem  [3]  an<l  also  by  considering  the  program: 

Minimize  xT[dK/Bx]  -  yT[dK/By] 

~  [dK/dx]  ^  0 
-[dK/dy]  ^  0 
x  0 

y  o 


(4) 


subject  to 


which  clearly  has  the  form  (l)  under  the  identifications  (3).  Theorem  1 
applies  in  the  present  case  since 


fi 


and 


[dw/dz] 


for  all  (n  +  m) -vectors  y  } 


b2K/bx2 


■  d2K/dydx ' 


V 


d2K/dxdy  -d2K/dy2 
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d2K/dx2 

d^K/dxdy 


because  [dK/3x2]  and  -[d2K/dy2]  are  positive  semi-definite  due  to  the 
convexity  and  concavity  properties  of  K(x,y)  ,  respectively. 

As  an  example  of  the  above,  if  gj_  (x)  ,  0  £  i  ^  m  ,  are  convex  functions 
of  x  e  R  ,  the  convex  program 


Minimize  gQ(x) 

subject  to  g±(x)  £  0  (1  £  i  m) 

x  ^  0 

HI 

can  be  derived  from  K(x,y)  =  gQ(x)  +  2  y ±g±(x)  .  Another  example  is 

provided  by  a  function  of  the  form 

(5)  K(x,y)  .  (A  xTDx  +  cTx)  -  (£  yTEy  +  bTy)  -  yTAx 

where  D  and  E  are  symmetric  positive  semi-definite  matrices,  c  and  b 
are  constant  vectors,  and  A  is  an  arbitrary  matrix.  Symmetric  dual  quadratic 
programs  result  from  the  formulation  suggested  above.  See  [2]  .  A  program 
of  the  type  (l)  can  be  obtained  by  forming  the  combined  (self-dual)  problem: 

T  T  T  T 

xDx+yEy+cx+by 

T 

Dx  -  Ay  +  c^o 

Ax  +  Ey  +  b  0 
x  0 

y  0 

With  u=Dx-ATy+c,v=Ax+Ey+b,w=  (u,v)  and  z  -  (x,y)  ,  a  solution 


Minimize 
subject  to 


(6) 
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z  is  sought  such  that  z^0,w^0,  and  z^w  =  0  .  Such  a  vector  solves 
the  program  (6)  as  well  as  both  of  the  programs  out  of  which  it  was  formed. 

We  shall  now  study  properties  of  complementary  basic  solutions  of  the 
linear  system 

(7) 

Iw  -  Mz  =«  q 

where  w  =  (w^, . .  .,wN)  and  z  >  (z^, . .  .,Zj.)T  are  real  variable  vectors, 

T 

<1  ■  (%.>••*>%)  ls  known,  and  M  is  any  N  x  N  matrix  of  coefficients  which 

is  either  positive  semi -definite  or  positive  definite,  as  specified,  but  not 

necessarily  symmetric.  If  the  pair  (w,z)  ^0  satisfies  (7)  and  the  equation 
T 

z  w  =1  0  ,  then  z  is  optimal  for  the  quadratic  program 

T  T 

z  Mz  +  q  z 

Mz  +  q  0 

z  Z.  0 

Observe  that  (6)  may  be  cast  in  this  form  by  setting  q  =  (c,b)  and 


In  the  sum  on  the  right,  the  first  summand  is  positive  semi-definite  and  the 
second  is  skew  symmetric.  Therefore  M  is  positive  semi-definite.  For  the 
special  case  of  linear  programs,  D  =  0  and  E  =  0  ,  thus  zTMz  =  0  for  all 
N-vectors  z  . 

II.  Canonical  Equivalents 

DEFINITION  1:  Variable  pairs  (w^,z^)  will  be  called  complementary;  w  and  z^  will 
be  called  complements  of  each  other.  A  pair  (w,z)  of  N-vectors  is  a 


(8) 


Minimize 
subject  to 
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complementary  solution  of  (7)  provided. 


(10) 


Vi 


,  Z2W2  =  0, . . . , zNwN 


DEFINITION  2:  A  basic  set  of  variables  consists  of  any  ordered  set  of  N 
variables  w±  and  Zj  such  that  their  coefficient  matrix  in  (7),  called  a 
basis,  is  nonsingular. 

DEFINITION  3:  A  complementary  basic  set  of  variables  is  one  in  which  exactly 
one  variable  of  each  complementary  pair  (v^)  is  basic.  (For  example, 
w  is  a  complementary  basic  set.  If  M  is  a  singular  matrix,  then  z ■  can¬ 
not  be  basic,  although  it  is  complementary.  On  the  other  hand  M  =  (  0 

’  V-1  0' 

is  positive  semi -definite  and  z  =  (z^Zg)1  is  basic.) 


DEFINITION  k:  A  basic  solution  is  the  one  found  by  solving  for  the  values  of 
a  given  set  of  basic  variables  when  the  nonbasic  variables  are  set  equal  to 
zero.  (For  complementary  basic  sets,  basic  solutions  are  complementary  solutions.) 


DEFINITION  5:  The  canonical  equivalent  of  (7)  with  respect  to  a  basic  set  of 
variables  having  basis  B  is  the  system  obtained  by  multiplying  through  (7) 
on  the  left  by  B  1  .  We  observe  that  if  the  basic  set  of  variables  is 
complementary  and  is  redesignated  w  and  the  nonbasic  ones  denoted  by  z  then 
this  left  multiplication  results  in  a  new  canonical  form  w  =  M  z  +  q  . 

We  observe  that  (7 )  itself  is  in  canonical  form  with  respect  to  the 
complementary  basic  set  w  and  that  M  ,  the  negative  of  the  coefficient 
matrix  of  the  corresponding  nonbasic  variables,  is  at  least  positive  semi- 
definite.  William  P.  Drews  conjectured  that  the  same  may  be  true  for  M  the 
analogue  of  M  appearing  in  each  canonical  equivalent  of  (7)  with  respect  to 
a  complementary  basic  set  of  variables.  This  turned  out  to  be  true. 
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Independently  P.  Wolfe  established  the  same  result  for  M  of  form  (9)  and 

A.  Tucker  also  established  it  for  any  M  all  of  whose  principal  minors  are 
positive. 

THEOREM  2:  Given  any  canonical  equivalent  of  (7)  with  respect  to  a  comple¬ 
mentary  basic  set,  let  M  be  the  negative  of  the  transfomed  coefficient 
matrix  of  the  complementary  set  of  nonbasic  variables;  then  M  and  M  are 
either  both  positive  definite  or  both  positive  semi-definite,  or  both  have 

Principal  minors  with  both  positive  or  both  non-negative,  or  both  none  of 
these. 

H.OOJ-;  me  proof  .111  be  omitted  here  and  .111  be  contained  In  a  separate 
joint  paper  with  A.  Tucker  and  P.  Wolfe. 

III,..  Existence  of  a  Complement  ary  Non-Negative  Solution:  A  Constructive  ^ 
W.S.  Dorn  [5]  has  shown  that  for  a  positive  definite,  but  not  necessarily 
symmetric,  matrix  M  there  always  exists  a  non-negative  complementary  solution 

°f  (?);  oThat  1S’  th6re  6XiSts  a  v°  ^  0  and  a  Z°  n.  0  such  that  Iw°-Mz°  =  q 
and  z.w°  =0  for  all  i  .  One  of  the  authors  [2]  extends  this  result  to  the 
positive  semi-definite  case  under  the  assumption  that  a  non-negative  solution 

t°  (?)  eXiStS’  PPeSent  Active  is  to  prove  these  assertions  constructively 

for  matrices  with  all  positive  principal  minors  (and  hence  Dorn's  result  as  a 
special  case). 

THEOREM  3:  Given  any  complementary  basic  set  of  variables  w  of  system  (7) 
expressed  in  terms  of  nonbasic  variables  w  =  M  z  +  q  ,  then  M  has  a  positive 
or  non-negative  diagonal  according  as  M  has  all  principal  minors  positive  or 
non  negative  (or,  as  a  special  case,  M  is  positive  or  positive  semi-definite). 
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PROOF:  Let  v  be  any  complementary  basic  set  of  variables  selected  out  of 
(w,z)  and  let  z  be  the  complementary  nonbasic  variables.  Rewriting  (7)  in 
canonical  form  relative  to  7  yields  7  .  M  7  +  q  ;  let  M  have  all  positive 
(non-negative)  principal  minors,  then  by  Theorem  2  the  same  is  true  for  M 

and  hence  M  =  fa±J]  has  all  the  entries  a±1  on  the  diagonal  positive  (non¬ 
negative  ) . 

COROLLARY:  Given  v  =  M  7  +  q  ,  each  component  7  of  7  is  a  strictly  in¬ 
creasing  or  nondecreasing  function  of  7g  according  as  M  has  all  principal 
minors  positive  or  non-negative. 

A  complementary  basic  solution  will  be  said  to  be  out-of-kilter  if  one  or 

more  of  its  basic  variables  is  negative.  By  the  Corollary,  if  a  >  0  and 
—  —  ss 

ws  =  %  is  negative,  increasing  7.  from  its  current  value  of  zero  will  cause 

ws  to  increase  linearly  toward  zero.  Suppose  7  =  0  at  7  =,  ?  s  n  m 

S  s  s  ^  ^ 

this  case,  zg  can  replace  w^  in  the  basic  set,  and  its  value  in  the  new 

basic  solution  will  be  7?  >  0  .  If,  during  the  increase  of  7  ,  no  other  basic' 

s 

variable  becomes  negative,  the  resulting  basic  solution  is  still  complementary 

and  xs  'less  out-of -kilter . "  However,  if  some  other  variable,  say  7^  ,  goes 

negative,  we  will  say  that  the  increase  of  z  is  blocked  by  7  .  w<=  sh«n 

s  -  r 

show  that  the  increase  of  z  will  be  unblocked  by  replacing  7  in  the  basic 

r 

set  by  its  complement  z 

r 

THEOREM  4:  If  increasing  the  value  of  a  nonbasic  variable  z  causes  a 

_  S 

basic  variable  w  to  decrease,  and  if  z  can  replace  7  in  the  basic 

r  r 

set,  then,  after  replacement,  7  will  increase  with  increasing  z  .  For  m 

r  s 

with  all  positive  principle  minors  (which  includes  the  case  of  M  positive 

definite)  z  can  always  replace  7  . 

r  r 
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PROOF:  Let  M  =  [a^J  .  We  are  assuming  a^  <0  and  a^^o,  where 

arr  >0  if  M  has  all  positive  minors,  (Theorem  3).  To  obtain  a  new  canonical 

equivalent  after  replacing,  w  by  z  ,  we  reduce  the  coefficient  of  z  to 

1  r 

a  unit  column  by  pivoting  on  the  term  -arrzr  in  the  canonical  system  ' 

Iw  -  M  z  =  q  ;  this  results  in  a  transformed  matrix  M*  =  [a*  ]  in  which 

arr  "  1'1 arr  >  0  and  ars  =  "ars/arr  >  0  •  It  is  the  fact  that  a*  >  0  which 

__  rs 

Implies  that  z^  will  increase  with  increasing  z 

DEFINITION  6:  A  basic  solution  is  said  to  be  degenerate  if  one  or  more  of  its 
basic  variables  is  zero. 

A  standard  device  (in  linear  programming)  which  permits  one  to  proceed 
as,.,1*'  «TL  basic  solutions  were  nondegenerate  is  to  replace  the  vector  q  by 
a  matrix  [q,I]  .  The  components  of  w  and  z  then  become  vectors  which  are 
considered  to  be  lexico-positive  (lexico-negative)  if  their  first  nonzero 
component  (providing  such  exists)  is  positive  (negative).  Otherwise  they  are 
zero  vectors. 

THEOREM  5  (Dantzig,  Orden  and  Wolfe):  All  basic  solutions  of  (7)  are  non- 
degenerate  in  the  lexicographic  sense. 

PROOF:  The  proof  given  in  [4]  is  based  on  the  observation  that  the  vector 
values  of  any  set  of  basic  variables  with  basis  B  are  given  by  the  rows  of 

®  [q.>I]  -  [D  B  ]  and  each  row  of  B  has  at  least  one  nonzero 
component. 

In  the  discussions  which  follow,  all  ordering  relations  on  the  values  of 
basic  variables  should  be  interpreted  in  the  lexicographic  sense. 

THEOREM  6:  If  one  nonbasic  variable  7,  is  allowed  to  take  on  any  vector 
value  and  if  the  other  nonbasic  variables  take  on  any  fixed  values  in  their 
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first  component  and  zero  in  the  rest,  then  at  most  one  basic  variable  can  be 
a  zero  vector. 

PROOF:  Set  the  nonbasic  variables  other  than  7  at  their  fixed  values,  and 
let  zg  be  the  zero  vector.  Then  the  values  of  the  basic  variables  are  non¬ 
zero  by  the  same  argument  as  in  Theorem  5.  If  some  basic  variable  wr  is  to 

vanish  for  some  other  vector  value  of  7  ,  say  7  =■  z°  ,  then  it  must  be 

s  s  s 

possible  to  interchange  vr  and  7g  as  basic  variables.  But  the  new  basic 

solution  (which  is  the  same  as  the  prior  one  obtained  by  setting  7  =  T3  )  is 

s  s  a 

nondegenerate,  so  that  no  other  basic  variable  can  have  a  zero-vector  value. 

We  are  now  prepared  to  deal  with 

THEOREM  7:  If  M  has  all  principal  minors  positive,  there  exists  a  non¬ 
negative  complementary  solution  to  (7),  i.e.,  to  Iw  -  Mz  =.  q  . 

Our  proof  will  be  constructive.  First  we  introduce  some  notation: 
i)  let  (w3,?3)  =  (q,o)  be  any  complementary  basic  solution  to  (7); 

ii)  let  (wt,7fc)  be  the  solution  to  (7)  such  that  T*3  =  (0, . .  ,0,7t,0, . . ,0) 

s 

ITERATIVE  PROCEDURE: 

Step  0  Set  (w,z)  =  ( w 3,73)  and  (w,z)  =  (q,0)  as  the  starting  solution. 

Step  la  If  (w3,?3)  ^_0  ,  terminate;  the  solution  satisfies  the  theorem. 

Step  lb  If  not,  let  zg  be  any  z 1  such  that  w^  0  .  Let  t  =  0  . 

Step  2  Set  z^+1  =  M0-*  zs  ^  such  that  w^+b  0  and  w^+1  ^  0  if 

■w*  0  • 

Step  3  If  w^+1  =0  ,  (i.e.,  the  lexicographic  vector  7.  vanishes)  replace 

Wr  by  ^r  ln  the  baslc  set* 

Step  4a  If  r  =  s  ,  return  to  Step  la. 
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Step  4b  If  r  /  s  ,  return  to  Step  2  with  t  +  1  replacing  t  . 

PROOF:  In  the  interval  z  <  z  <  z  .no  variable  can  change  sign  and  become 

s  s  s 

negative  (by  the  definition  of  z^+1  in  Step  2. )  Hence  v  ,  the  number  of  basic 
variables  with  negative  values,  stays  the  same  or  decreases  if  a  negative  vari¬ 
able  becomes  ncn-negative.  The  latter  is.  always  the  case  if  r  =  s  in  Step  4a, 

because  w^  (originally  negative)  has  been  increased  to  zero  value.  Therefore 
s 

there  can  be  only  a  finite  number  of  returns  to  Step  la  before  all  the  variables 
are  non-negative.  Consider  now  returns  to  Step  2.  Initially  there  is  a 
(lexico-)  positive  increase  of  zg  in  an  interval  0  zs  ?;  because  of  the 

— t  — t 

nondegeneracy  of  the  basic  solution.  If  r  ^  s  ,  and  w^  >  0  for  zs  and 

w^+1  =  0  ,  then  arg  <  0  and  the  replacement  of  w^  by  permits  zg  to 

be  increased  by  Theorem  4  and  Theorem  6.  There  can  be  only  a  finite  number  of 

returns  to  Step  2  with  the  same  basic  set  until  the  largest  zg  is  attained 

for  which  w  <  0  and  v  is  minimum.  Since  the  number  of  different  basic 
s 

sets  is  finite,  the  proof  is  complete. 

The  Case  for  M  Positive  Semi -Definite 

THEOREM  8:  If  increasing  the  value  of  a  nonbasic  variable  zg  causes  a  basic 

variable  wr  to  decrease,  and  if  z  cannot  replace  wr  in  the  basic  set,  then 

(z  ,z  )  can  always  replace  (w  ,w  )  as  basic  variables;  moreover,  increasing 
s  r  sr  ' 

w  will  increase  z 
s  r 


PROOF:  If  M  is  positive  semi-definite,  it  may  happen  that  a 


0  and 


consequently  that  it  is  impossible  to  replace  w^  by  z^  .  In  this  case,  the 
2x2  submatrix 


(11) 


M_ 


ss 


rs 


rr 
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has  entries  satisfying  the  conditions 


(12) 


ass  '  arr  =  0  '  asr  +  ars  =  0  >  and  asr  >  0 


The  third  of  these,  agr  +  =  0  ,  follows  from  the  fact  that 

T  2 

*  m  m  ass\  +  ^asr  +  ars^lX2  must  be  Positive  semi-definite  (which  in  turn  is 

true  because  M  is  positive  semi -definite).  The  positivity  of  a  is  a  con- 

sr 

sequence  of  the  assumption  that  wr  decreases  as  "z  increases.  Since  the 
submatrix  Mg  is  nonsingular,  tne  replacement  is  possible  [9]  .  Finally  ~z 
(now  in  the  basis)  increases  with  increasing  w  (now  outside  the  basis) 

because  a  >  0  . 
sr 

THEOREM  9:  No  non-negative  solution  exists  if,  for  some  s  all  a  >0 


a  =  0  ,  and  q  <•  0 
ss  *  s  v 


PROOF:  As  in  the  proof  of  Theorem  8,  if  a  =0  then  a  =  -a  <0  There - 

•  ss  si  is  -1*- 

fore  equation  s  consists  of  all  nonpositive  coefficients  and  a  negative 
constant  term,  and  hence  is  not  solvable  in  non-negative  variables. 

In  developing  an  analogue  of  the  positive  definite  case,  we  note  that  if 
the  conditions  of  Theorem  9  hold,  zg  can  be  increased  indefinitely  without 
making  any  w±  change  sign  and  become  negative.  In  the  example  (13)  below, 
qx  <  0  and  z^  can  be  increased  as  much  as  desired  without  inducing  any  sign 
changes  in  the  basic  variables.  Letting  z^  -*  +a>  we  have  w^  =  -l  ,  w^  =  1  , 
w3  =  1  +  zl  +°°  >  and  w4  =  -1  "  z±  -  •  This  problem  is,  however,  solvable. 


(13) 


W1 

W2 

W3 

w4 

Z1 

z2 

z 

3 

\ 

<1 

1 

0 

0 

0 

0 

0 

1 

-1 

-1 

0 

1 

0 

0 

0 

0 

1 

1 

1 

0 

0 

1 

0 

-1 

-1 

0 

0 

1 

0 

0 

0 

1 

1 

-1 

0 

0 

-1 
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The  device  we  have  used  to  prevent  the  values  of  basic  variables  from 

tending  to  -«  is  to  impose  a  uniform  negative  lower  limit  £  for  variables 

with  negative  values.  (A  nonuniform  lower  limit  will  do  as  well.)  Once  a 

variable  rises  into  the  non-negative  range,  its  admissible  lower  limit  is 

changed  back  to  zero.  If  we  start  with  the  complementary  basic  solution 

(w,z)  =  (q,o)  ,  we  may  set  l  =  Min  ^  .  (if  Min  ^  ^  0  ,  then  (q,o)  solves 

the  problem.)  Since  z^  =  0  initially,  z^  ^  0  will  hold  in  all  subsequent 

iterations.  From  these  considerations,  it  follows  that  at  most  one  variable  of 

each  complementary  pair  can  ever  be  negative.  If  a  basic  variable  w  (with 

negative  value)  decreases  to  £  when  zg  is  increased,  w  is  to  be  replaced 

in  the  basic  set;  it  becomes  a  nonbasic  variable  with  value  w  =  £  . 

r 

We  shall  modify  the  notations -of  Theorem  7  to  treat  the  positive  semi- 
definite  case. 

(i1)  Define  ( w ° ,1?)  to  be  any  solution  of  (7)  such  that  =  0  or 
£  ,  where  z^  =  £  implies  w^  )>  0  . 

(ii1)  Define  ( w t ,z^)  to  be  the  solution  to  (7)  such  that 

=■  +  (0, ...,0,er  -  i°,0, .  ,0)  for  some  z4  . 

s  s  s 

MODIFIED  ITERATIVE  PROCEDURE: 


Step  O' 
Step  la' 
Step  lb' 
Step  2a' 

Step  2b' 
Step  2c' 
Step  Ja ' 


Set  (w,z)  =  ( w°,z* 3)  and  (w,z).=  (q,0)  as  the  starting  solution. 

If  (w  ,z°)  ^  0  ,  terminate.  The  solution  satisfies  the  theorem. 

Let  z  be  any  z  such  that  w*?  <  0  or  z?  =  £  ;  let  t  =  0  . 

si  11 

Set  rt+1  =  Max  ~  %  z1"  such  that  ((w^41  <0  if  w*'  <  0  or 
s  S*“S  s  ^  s 

^+1  10  if  ^  <  0)  and  (^+1^.0  if  ^0)). 
if  ^+1  =  +00  ,  terminate.  No  feasible  solution  exists. 

— t+1 

If  zg  =  0  ,  return  to  Step  la'. 

If  wf  =  0  or  £  ,  and  a^  /  0  ,  replace  w^  by  z  in  the  basic 


set. 
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Step  3b'  If  wr  -  0  or  i  ,  and  arr  =  0  ,  replace  (v^)  by  (z^T.)  ln 
the  basic  set. 

Step  4a'  If  r  =  s  ,  return  to  Step  la*. 

Step  4b-  If  r  +  s  ,  return  to  Step  2a*  with  t  +  1  replacing  t  . 

THEOREM  10:  If  zr  in  the  basic  set  increases  with  increasing  z  outside  the 

s 

basic  set,  then  the  sane  class  of  solutions  is  generated  by  putting  z  in  the 

__  s 

basic  set  in  place  of  z  and  increasing  ~z 

r  r 

PROOF:  There  is  only  one  degree  of  freedom  and  the  relations  are  linear. 

Paraphase  Summary  of  the  Algorithm 

We  may  thus  simplify  the  foregoing  procedure  into  saying  in  effect : 

(0)  Increase  zg  until  some  w^  drops  to  0  (or  i),  replace  w  by  z 

1  ^  s 

(l)  increase  z  until  some  wf  drops  to  0  (or  £) ,  replace  w  by  z 


(k)  increase  z  until  some  wr  drops  to  0  (or  i),  replace 

k-1  jj 

Wr  hy  ~r  ; 
k  rk-l  . 

(k+l)  increase  z  until  wg  increases  to  0  ,  replace  by  z  ,  where 

_  rk 

we  denote  by  w±  any  variable  in  the  current  basic  set  -  although 

it  may  be  the  same  as  some  which  was  earlier  not  in  the  basic 


From  these  discussions,  the  following  observations  can  be  made : 

THEOREM  11  (Cottle  (2]  ):  If  Iv  -  Mz  =  q  is  solvable  in  non-negative  variables 

where  M  is  positive  semi -definite,  there  exists  a  non-negative  complementary 
solution. 

NOTE:  The  positive  definite  case  was  shown  by  Dorn  [5]. 


-14- 


I 


THEOREM  12:  Iw  -  Mz  =  q  is  not  solvable  in  non-negative  variables  if  and  only 
if  the  representation  of  some  column  s  in  terms  of  some  complementary  basis 
has  nonpositive  weights  with  zero  weight  on  the  complementary  column  whereas 
the  representation  for  q  has  a  negative  weight  for  this  column. 
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